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Amendmen ts to the Claimsi 

Tto listing of claims will replace all prior versions, and listings, of claims in the application: 

t 

I -isting of Claims; 

1 . (Currently Amended) An interactive operation supporting system for an apparatus, 

i 

i 

comprising a display unit, a speech input unit, a speech output unit and an operation control unit, 

i 
i 

wherein said operation control unit includes: 

an assistant control means for generating a personified assistant and making said assistant 

appear on a screen of said display unit; 

i 

an output speech control means for determining speech required for said assistant to 
output said assistant's speech to lie outside through said speech output unit after speech 

t 

synthesis; j 

i 

i 

an input speech recognition means for recognizing user's voice as a speech inputted 

t 

t 
i 

through said speech input unit; 

i 

i 

an interaction management means for managing interaction between said assistant and 

! 

said user according to said assistant's speech determined by said -output speech control means 
and said user speech recognized by said input speech recognition means; 

! 

an ambient state generating means for enabling said personified assistant to make 
motions in a proper way or to act as if urging the user to input commands using the input speech 

t 

recognition means when the interactive operating system is placed in a wait state; and 

i i 

I 

a command interpreting means for specifying a user's intention or specifying said 

j 

inputted user command based ofi a content of interaction traced by said interaction management 

i 

means. : 
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(Original) The interactive operation supporting system according to claim 1, wherein 

determines an animation of said assistant based on a content of 

i 

gement means and/or an inputted user command 



said assistant control means 
interaction managed by said 



interaction maim 



specified by said command interpreting means. 



i i i 

3. (Original) The interactive operation supporting system [according to claim 1, wherein 



said output speech control means determines an assistants speecrj based on a content of 
interaction managed by said interaction management means and/or an inputted user command 

t ( 

! 1 
specified by said command interpreting means. 



4, (Original) The ir 



teractive operation supporting system according to claim 1 , wherein 

i ' j 

said output speech control means; determines an assistant's speech for leading a user's intention 



when said command interpretmgjmeans fails to specify said userjs intention or said inputted user 



command. 



J 



S. (Original) The interactive operation supporting system according to claim 1, further 



comprising 

a connection means for cbnnecting an external apparatus 



such as a television set/monitor 



and/or a video deck lo said system, wherein said command interpreting means also interprets a 

I i 

command for controlling J function of said external apparatus including selection of a broadcast 

3 
•\ 

program channel and/or rebording/reproducing of said broadcast program. 



00343221 



PAGE 5/34 * RCVD AT 41312006 2:31:10 PM [Eastern Daylight Time] 1 SVR:USPTO-EFXRF-2/12 * DNIS:2738300 ' CS1D:12125880500 * DURATION (mm-ss):09-56 



"S$T AVAILABLE COPY 



04/03/2006 14:31 FAX 12125880500 



FROMMER LAWRENCE & HAUG 



..1 



igiooe 



PATENT 

Appl. No. 09/911,109 

Attorney Docket No. 450100-03355 



6. (Original) The 



interactive operation supporting system according to claim 1, further 



comprising 

a communication means for connecting said system to a communication medium such as 

an external network or a telephone line, 

wherein said input speech recognition means recognizes audio data received via said 

■ 

t 

t 

communication medium. 



7, (Original) The interactive operation supporting system 



according to claim 1 5 further 



comprising 

a communication means for connecting/said system to a cjo 

an external network and/or a telephone line, land j 

"1 



immunication medium such as 



a mail exchange means for making an exchange of electronic mails via said 

I 

I 
I 

communication medium, 

wherein said output speech control means determines saiS assistant's speech based on a 

content of an incoming mail. 



8. (Original) The interactive operation supporting system according to claim 1, wherein 

1 ' I 

said interaction management means manages an input speech ofla user as a message bound for 

i : j 

another user, and said output speech control means determines said assistant's speech based on 



said message. 



r 
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i 



lip * 

9. (Original) The interactive operation' supporting, system according to claim 1, wherein 
said assistant control means place* said personified assistant in a ijoom scattered with various 

i ! - 

kinds of objects including a link to an information resource. 



10. (Original) The interactive operation supporting systeri according to claim 1, wherein 
said assistant control means places said personified assistant in a room scattered with various 



I 



I : 



I 



kinds of objects including a link to an information resource, and ih response to an interest of said 

user in a recording medium including a link to k music content placed in said room, said 

' ii i* 

command interpreting means interprets an in^tted userijcommanjd as a command for playing 

t 
i 

back said music content. 



II'' 
11. (Original) The interactive operation supporting system according to claim 1, wherein 



m response 



to said command interpreting means interpreting an inputted user command, said 



assistant control means makes said assistant appear on a : screen df said display unit. 

i ■ i 



12. (Original) The interactive operal 



■ i i 

oh supporting systdin according to claim 1, further 



comprising ! it 

in | 

a connection means for connecting a television set/monrbr to said system, and in 

i ■ ■ 

response to said command interpreting means interpreting an inputted user command as a 



channel selection command, said assistant control means makes 
broadcasting program display window. j f 



i i 



i 



! : 5 



if,. 



said assistant show a selected 
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13. (Original) The interactive operation supporting system 



according to claim 1, further 



comprising 

a connection means for connecting a television setjtaonitoj to said system, wherein in 

response to said command interpreting means interpreting an inp J ted user command as a 

i 

channel change command, said assistant control means placing a jing-shaped changeable 

i 

j | 

broadcasting program display window around said assistant 



1 1, 
i. 

tr 



12)008 



14. (Original) The interactive operation supporting systei l according to claim 13, 

wherein, in response to selection 6f a desired channel by moving said display window on said 

! i;' 



ring upon a 



channel change command from said user andE said assistant control means also zooms 



up said selected broadcasting program display window, ji 



15 (Original) The interactive operation supportmg system according to claim 1, further 

: li 



II 
ii 

I- 



comprising , ; 

j » 

a connection means for connecting a secondary storage device for storing and/or 

i . i 

reproducing a broadcasting program content to said system, 

wherein in response to said command mteipretirijg means interpreting an inputted user 

* i 

command as a recorded program! reproduction command, said assistant control means makes said 
assistant show a binder showing 'a view of recorded broadcasting program contents. 



i : 



6: 
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16. (Original) The interactive operation supporting systenj according to claim 15, 
wherein in response to a selection for reproducing Recorded broking program content, said 



assistant control means zooms up 



window. 



jsaid selected recorded broadcasi ing program content display 



17. (Original) The interactive operation supporting systerji according to claim 1 , further 
comprising 

a connection means for connecting a television sefc/monitcjr to said system, 
wherein in response to said command interpreting means uterpreting an inputted user 
command as a channel change command, said assistant control n eans makes said assistant 

1 1 
i 

appear with a list of changeable broadcasting programs atrangedjn a matrix shape. 

i' 

i: 

18. (Original) The interactive operation supporting syst^ n according to claim 17 : 
wherein in response to a selection of a desired channel, Jaid assiftant control means 200ms up 
said selected broadcasting program display window. 



19. (Original) The interactive 



wherein EPG distributed as part of data broadcast 
programs in a matrix form. 



operation supporting systc m according to claim 1 7, 

I 
■ 

is applied for generating a list of broadcasting 



r 
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20. (Original) The interact 



FROMMER LAW RENCE & HAUG 
' I 



@ 010 



ve operation supporting system according to claim 1, further 



comprising 

a connection means for connecting a television set/monito 
a communication means for connecting said system to a 



an external network and/or a telep 



a mail exchange means foi 



medium, 



a 



to said system, 



cd mmunication medium such as 



iione line, and 

making exchange of elcctronidmails via said communication 



1 i 

wherein said assistant contol means makes an incoming ljiail display image to appear on 

I 

screen of said display unit in response to acceptance of mail 



21. (Original) The interactive operation supporting syste) a according to claim 1, further 



comprising 



I 



a text conversion means for converting a Japanese ideogrfm Kanji related to text data 

■ 

displayed on a screen of said display unit into a corresponding p|onetic character Kana. 



22. (Original) The interactive operation supporting sys«|a according to claim 1, further 
comprising 

i 

a communication means for connecting said system to a |ommuni cation medium such as 

| 

an external network or a telephone line, and 

■ 

■ 
i 

a certifying means for certifying an information termina] 

i 
i 

said communication medium. 



8 



connected to said system via 
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23. (Original) The interactive operation supporting systeir 



©Oil 



according to claim 1 , further 



comprising 

a connection means for connecting a television set/monito j to said system, and 

■ 

extraction means for extracting text information from Received broadcasting prog 



an 



content. 



ram 



24. (Original) The interactive operation supporting systei } according to claim 23, 

wherein text information extracted by said extraction means is suj&erimposed on a content of 

i 
i 

another broadcasting program on said screen. 



25. (Currently Amended) 



or other externally connected apparatus including a display unit 
output unit, comprising: !' 

an assistant control step for generating a personified assi; 



A method for supporting intercjpive operation of an apparatus 

speech input unit and a speech 



Lt and making said generated 



assistant appear on a screen of said display unit; 

an output speech control :ilep for determining a speech rluiTed for the assistant to output 

the assistant's speech to the outside through said speech output r|iit after speech synthesis; 



an 



input speech recognition step for recognizing a user's fcoice as a speech inputted 



through said speech input unit; 

an interaction management step for managing intcractioij between said assistant and said 
user according to said assistant's speech determined by said outijut speech control step and said 
user speech recognized by said input speech recognition step; 
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an 



recognition step 
a 



FROMMER LAWRENCE & HAUG 

■ - [ft 



@012 



bm proper way or tn act as if urgiAg the user to input commands Asing the input speech 



when the interactive operating system is placed iij a wait state; and 



command interpreting step for specifying said user's intention or specifying said 
inputted user command baseli on a content of interaction traced bjf said interaction management 



step- 



i 



26. (Original) The iiietho<& for supporting interactive operation according to claim 25, 
wherein said assistant control step determines an animation of safd assistant based on a content 



of interaction managed by skid infraction management step and|>r an inputted user command 
specified by said command jinterp reting step. 



27. (Original) The methold for supporting interactive operation according to claim 25 



wherein said output speechjcantrbl step determines an assistant's 

j | 
interaction managed by sai| interaction management step and/or 

specified by said command interpreting step 



28. (Original) The inethid for supporting interactive operation according to claim 25 



speech based on the content of 
an inputted user command 



j 



10 



wherein said output spceclJ control step determines an assistant's! speech for leading a user's 

I 

intention when said command interpreting step fails to specify skid user's intention or said 



inputted user command. 



00343221 



PAGE 12/34 ' RCVD AT 4/3/2006 2:31:10 PM [Eastern Daylight Time] ' SVR:USPT0-EFXRF-2/t 2 ' DNIS:2738300 * CSID:12125880500 1 DURATION (mn>ss):09-56 



BEST AVAILABLE COPY 



04/03/2006 14:33 FAX 12125880500 



FROMMER LAWRENCE & HAUG 



T 



PATENT 

Appl.No- 09/911,109 
Attorney Docket No. 450100-03355 



29. (Original) The method for supporting interactive operation according to claim 25, 
wherein said apparatus further includes a connection means for cc Lecting an external apparatus 
such as a television set/monL and/or a video deck to said appa* tus, and said command 
interpreting step also interprets commands for controlling a functijm of said external apparatus 
including selection of a bJdcast program and/or recording/reproducing of said broadcast 



program. 



11013 



30. (Original) The rnelhod for supporting interactive ope: ation according to claim 25, 

lor connecting said apparatus to 



wherein said apparatus further includes a communication means 

a communication medium ich as an external network and/or a tllephone line, and said input 
speech recognition step recognizes audio data received via said communication medium. 

i . 



r 

i 

I , 

i 1 

31 . (Original) The methojd for supporting interactive opetetion according to claim 25, 
wherein said apparatus further includes a communication means for connecting said apparatus to 

i i j 

j J 

a communication medium such a|s an external network and/or a telephone line, and a mail 
exchange means for making an exchange of electronic mails via said communication medium, 

i 

said output speech control step determining said assistant's speech based on a content of an 
incoming mail. 



for another user, and said Output 



said message. 



ii 



■ 

■i 



32. (Original) Thepethnd for supporting interactive opsration according to claim 25, 

wherein said interaction management step manages an input spejsch of a user as a message bound 

said assistant's speech based on 



speech control step determines 



11 
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33. (Original) The method 
wherein said assistant control step 



various kinds of objects including 



FROMMER LAWRENCE & HAUG 



for supporting interactive oper 

i 
i 

places said personified assist 
a link to an information resour 



@014 



[tion according to claim 25. 
in a room scattered with 



34. (Original) The mjethoci for supporting interactive opefction according to claim 25, 
wherein said assistant control step places said personified assistant in a room scattered with 

i i 

various kinds of objects inclidinj a link to an information resour| e > ^ in response an interest 

i 
i 

of said user in a recording mediuAi including a link to a music c< 



command interpreting step interprets an inputted command as a 



music content. 



rtent placed in said room, said 



>mmand for playing back said 



35. (Original) The method for supporting interactive op< 



wherein in response to said comrkand interpreting step interpreting an inputted user command, 



said assistant control step mjakes 



set/monitor to said apparatus, and in response to said command 



ation according to claim 25 > 



said assistant appear on a scree I of said display unit. 



36 (Original) The rhelhdd for supporting interactive op* ration according to claim 25, 

; ; - . 

wherein said apparatus further irlcludes a connection means for onnecting a television 



Interpreting step interpreting an 



inputted user command as a channel select command, said assis ant control step makes said 

'i 

assistant show a selected broadcasting program display window 



: 12 



.■ • 
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interactive operation according to claim 25, 



37. (Original) The methodjfor supporting 

■ 

wherein said apparatus further includes a connection means for connecting a television 
set/monitor to said apparatus, and in response to Lt said command interpreting step interpreting 



an 



inputted user command as a channel change cemmand, 



changeable broadcasting program 



said as sistant control step places a 
display window with a shape of a ring around said assistant. 



38. (Original) The method for supporting interactive operation according to claim 37, 
wherein, in response to selection 6f a desired channel by moving|said display window on said 



ring upon a channel change command from said 

i | 

up said selected broadcasting program display window 



user and 



said assistant control step also 200ms 



• 1 



39. (Original) The method for supporting interactive operation according lo claim 25, 

i I 

wherein said apparatus further includes a connection medns for connecting a secondary storage 

device for storing and/or reproducing a bro£dca:ting program colitent to said apparatus, and in 

i I | 

response to said command interpreting step interpreting m inputted user command as a recorded 

program reproduction command \ said assistant control stsp makes said assistant show a binder 

j | i * 

showing a view of recorded broadcasting program contents. 



40. (Original) The method for suppbrtirig interactive operation according to claim 39, 
wherein in response lo a selection for reproducing a recorded broadcasting program content, said 



assistant control step zooms up said selected recorded broadcasting program content display 



window. 



13 



1 1 
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41. (Original) The method' for supporting interactive open 



wherein said apparatus further includes 



a connection means 



response to 



@016 



for connecting a television sdtymonitor to said apparatus, and in 

\ 



tion according to claim 25 . 



said command interpreting step interpreting ail inputted user command as a channel 
change command, said assistant control step makei said 'assistant ^ppear with a list of changeable 

I 

I I 

I.I 

1,11 

42. (Original) The method for supporting interactive opei ation according to claim 41, 
, ^ ^™ tn * election of a desired clUneL salid assis ;ant control step zooms up si 



wherein in response to a selection of a desired enamel, ? 

■ 
■ 

selected broadcasting program display window. 

■ 



11 « 

43. (Original) The method for supporting interactive ope: 

i ! . ! j! 1 

wherein EPG distributed as pari of data broadcast is app 

! i 

programs in a matrix form. 



44, (Original) The method for support^ jinter^stive operation according to claim 25, 

wherein said apparatus further includes a connection means for donnecting a television 



ration according to claim 41, 
' led for generating a list of broadcasting 



communication medium such as jan external netjjvlork and/or a te 



i 

t 



!■ i I li 

set/monitor to said apparatus, a communication jirieans For connecting said apparatus to a 

1 ! i; | 

ephone line, and a mail 



exchange means for making exchange of electronic mai 
said assistant control step makes 
display unit in response to acceptance of mail, j . 



s via sa d communication medium, and 



an incoming mail display image to appear on a screen of said 



14 
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■! jjjf 

45, (Original) The method for supporting intend^ operation according to claim 25, 



i 



Kanji related to text data 



further comprising 

a text conversion step for converting a Japanese ideogram 
displayed on a screen of said display unit into a! corresponding phonetic character Kana. 



017 



46. (Original) The method for supporting interactive operation according to claim 25, 

i 

further comprising 

a communication step for connecting s^id appals to a communication medium such as 
an external network or a telephone line, and 

a certifying step for certifying an infonpation terminal connected to said apparatus via 



said communication medium- 



! 1 . 



• ,i "I 

47. (Original) The method for supporting intera^ve operation according to claim 25 

i 



wherein said apparatus further includes 

a connection means for connecting a television s^t/moniljor to said apparatus, and 



an extraction step for extracting text in 



content. 



48 (Original) The method for supporing intereitivc operation according to claim 47, 

kj 

wherein text information extracted by said extraction st$ is superimposed on a content of 



another broadcasting program on said screen. 



formationll&om a jeceived broadcasting program 



!!i 



15 
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49. (Currently Amended) A storage medium storing a software program in computer- 
readable form, said software program describing an interactive operation support processing for 

t 

omputer system, said interactive' operation support processing applied to an 

i 

I 

apparatus including a display unit, a speech input unit and.a speech output unit for supporting 
input of a user command to said apparatus and/or another externally connected apparatus, 



wherein said software program includes: 

■ 

an assistant control step for generating a 



personified assistant to make said generated 



■ 

assistant appear on a screen of sai i display unit:; \ 

an output speech control sLep for deterrrJjning a speech required to said assistant for 
output of said assistant's speech to the outside through said speech output unit after speech 



synthesis; 

an input speech recognition 



step for recognizing a user's lfbicc inputted through said 



speech input unit as speech; 

interaction management step for managing interactionfoetween said user and said 



an 



assistant according to said assistant's speech determined by said output speech control step and 

1 

said user speech recognized by said input speech recognition step; 

! i r 

an ambient state generating step for enabling said personified assistant to make motion* 

' ; •• \ 

inaproporwayono-act as if urging the user to input.commands using the input speech 
recognition step when the interactive operating system is placed tin a wait state; and 



a command interpreting step for specifying said user's intention or said inputted user 

i ji 

command based on a content of interaction traced by said interaction management step. 



16 
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i fc 

t 

i 



Ig]019 



50. (Original) The interactive operation supporting system according to claim 1, further 



u 



} 



comprising • 

a code conversion means fpr converting L character related to text data according to a 

group or system of characters or c;odes displayed on said display unit into a corresponding 

character of another group or system of characters or codes. 

: ! ■ 

i ' 

! I 

| j J 

51. (Original) The method for supporting interactive operation according to claim 25 



further comprising 



a code conversion step fol converting a character related to text data according to a group 



or 



system of characters or codes displayed on said display unit into a corresponding character of 



another group or system of charabters or codes 



52. (Previously Presented) The interactive operation supporting system according to 



claim 1, wherein said motions or 



said act includes a leading ques 



ition. 
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